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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 
CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 

1 .17(e) has been timely paid, the finality of the previous Office action has been withdrawn 
pursuant to 37 CFR 1.1 14. Applicant's submission filed on 12/19/2008 has been entered. 

Response to Amendment 

2. The amendments, filed on 12/19/2008, have been entered and made of record. Claim 39 has 
been cancelled, and claims 55-60 have been added. Claims 1-38 and 40-60 are pending. 

Response to Argument 

3. Applicant's arguments with respect to independent claims 1 , 23, and 43 and dependent 
claims 2-22, 24-38, 40-42, and 44-60 have been considered but are moot in view of the 
newly found prior art references. 

Claim Rejections - 35 USC § 102 

4. The text of those sections of Title 35, U.S. Code not included in this action can be found in a 
prior Office action. 
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5. Claims 1, 23 and 43 are rejected under 35 U.S.C. § 102(e) as being anticipated by Brooks 
(US 2003/0210139). 

Regarding claim 1, Brooks discloses an apparatus for the analysis (evaluation process 
100, Fig 1) of at least one first captured agent-traveler interaction (at airline passenger check- 
in counters) and at least one second agent-traveler interactions (at each security check point 
and/or at each gate), the apparatus comprising: 

an at least one first station (at airline passenger check-in counters) for 
capturing substantially the full audio, video, and data (the video, which 
including audio and data, can be recorded 24 hours a day on a system) of the 
at least one first agent-traveler interaction along a path of a traveler ([0020], 
[0045], [0048]-[0049]); 
- an at least one second station (at each security check point and/or at each gate) 
for capturing substantially the full audio, video, and data (recorded 24 hours a 
day) of the at least one second agent-traveler interaction along the path of the 
traveler, wherein the at least one second agent-traveler station is located at a 
location other than the first agent-traveler station ([0020], [0045], [0048]- 
[0049]); 

and an analysis device (an analysis system 324) for comparing the audio, 
video, and data of the at least one first agent-traveler interaction with the 
audio, video, and data of the at least one second agent-traveler interaction to 
determine, based upon a predetermined rule, a discrepancy (i.e. to determine 
suspect travel patterns and anticipate suspect activity) ([0053]). 
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Regarding claim 23, this claim differs from claim 1 only in that the claim 1 is an 
apparatus claim whereas claim 23 is a method. Thus the method claim 23 is analyzed and 
rejected as previously discussed with respected to claim 1 above. 

Regarding claim 43, this claim recites same limitations as claim 23. Thus it is analyzed 
and rejected as previously discussed with respect to claim 23 above. 

Claim Rejections - 35 USC § 103 

6. The text of those sections of Title 35, U.S. Code not included in this action can be found in a 
prior Office action. 

7. Claims 2-17, 19, 24-32, 34-38, 40, 42, 46-47, and 54 are rejected under 35 U.S.C. § 103(a) as 
being unpatentable over Brooks (US 2003/0210139) in view of Waters (US 6,396,535). 

Regarding claim 2, the limitations of claim 1 are taught above, Brooks does not disclose a 
control station for storing the at least one first and second interactions captured. However, 
Waters discloses a control station (analyzing synthesizer 200, Fig 1) for storing the at least 
one first and second interactions captured (2:46-58, Waters). Therefore, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to choose the 
control station as taught by Waters, so as the synthesizer can integrating information 
extracted from the multiple video streams into a single display, as the alert signals may be 
generated when certain dangerous situations or events are recognized (2:46-48, Waters). 

Regarding claim 3, the limitations of claim 1 are taught above, Brooks does not disclose 
an alarm identifier device for identifying an alarm situation based on the comparing of the at 
least one second interaction with the at least one first interaction. However, Waters discloses 
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an alarm identifier device (analyzing synthesizer 200, Fig 1, Waters) for identifying an alarm 
situation (certain dangerous situation or event are recognized) based on the comparing of the 
at least one second interaction with the at least one first interaction (multiple attributed 
objects are analyzed to detect events) (2:46-3:2, Waters). 

Regarding claim 4, the limitations of claims 1 and 3 are taught above, Waters discloses 
an alarm-generating device (an output device 150, i.e. a bell, Fig 1) for generating an alarm 
(alerts 252, Fig 2) associated with an alarm situation (certain dangerous situation or event are 
recognized) identified by the alarm identifier device (analyzing synthesizer 200, Fig 1) (2:46- 
3-2, Waters). 

Regarding claim 5, the limitations of claim 1 arc taught above, Waters discloses a station 
poll data device (analyzing synthesizer 200, Fig 1) for polling stations (video streams 115, 
Figs 1-2) for the at least one first and second interactions (multiple video cameras 101-106, 
Fig 1) (2:46-3:12, Waters). 

Regarding claim 6, the limitations of claim 1 are taught above, Waters discloses a station 
transfer data device (analyzing synthesizer 200, Fig 1) for managing data (extracting 
temporal and spatial data from the video streams to identify objects and their attributes) 
transferred from stations for the at least one first and second interactions (multiple video 
cameras 101-106, Fig 1) (2:46-58, Waters). 

Regarding claim 7, the limitations of claim 1 are taught above, Waters discloses a 
database (partially attributed data objects 231, Fig 2) for storing and retrieving the at least 
one first and second interactions (3:18-42, Waters). 
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Regarding claim 8, the limitations of claim 1 are taught above, Waters discloses a replay 
device (output device 120, Fig 1) for replaying at the least one first or second interactions 
(e.g. generating a synthetic display of multiple video cameras 101-106) (2:35-58, Waters). 

Regarding claim 9, the limitations of claim 1 are taught above, Waters discloses an object 
tracking device (analyzing synthesizer 200, Fig 1) for tracking an object within the at least 
one first or second interactions (various kinds of template matching schemes can be used to 
fully identify specific commonly occurring objects, such as, traveler and the like) (3:32-42, 
Waters). 

Regarding claim 10, the limitations of claim 1 are taught above, Waters discloses at least 
one first and second stations (camera 101 and 102, Fig 1) comprise at least one video 
capturing device (video cameras 101-106, Fig 2), an at least one audio recording device 
(synthesizer 250, Fig 2), an at least one data capture device (data analyzer 240, Fig 2). More 
specifically, Waters discloses at least one video capturing device for capturing video of the at 
least one first agent-traveler interaction or the at least one second agent-traveler interaction 
(video cameras 101-106, Fig 2), an at least one audio recording device for capturing audio of 
the at least one first agent-traveler interaction or the at least one second agent-traveler 
interaction (synthesizer 250, Fig 2), an at least one data capture device for capturing data of 
the at least one first agent-traveler interaction or the at least one second agent-traveler 
interaction (data analyzer 240, Fig 2), an at least one storage device (a cache 530, Fig 3) and 
an at least one storage device (secondary data 238, Fig 2) and an at least one data retrieval 
device (data render 260, Fig 2) (3:4-51, Waters). 
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Regarding claim 1 1 , the limitations of claim 1 are taught above, Waters discloses at least 
one first station and second station are located in the same transportation port (e.g. multiple 
cameras can be arranged to obtain a full field of view of an area of interest) (2:21-28, 
Waters). 

Regarding claim 12, the limitations of claim 1 are taught above, Waters discloses at least 
one first station and second station are located in remote transportation ports (e.g. a camera 
can transmit the data element from/to a remote location) (4:17-26, Waters). 

Regarding claim 13, the limitations of claim 1 are taught above, Waters discloses a 
second control room for recording and storing the at least one first and second interactions 
(e.g. image data of camera can transmit the data element from/to a remote control location) 
(4:17-26, Waters). 

Regarding claim 14, the limitations of claim 1 are taught above, Waters discloses a local 
or remote operator for observing the operation of the apparatus (the apparatus can be under 
user control and the user can supply control signal to the system) (4:17-26, Waters). 

Regarding claim 15, the limitations of claim 1 are taught above, Waters discloses the 
control station comprises a recording and retrieval system (information extracting from 
digital video data 201, data generating by analyzer 240, and data converting by synthesizer 
250) (3:4-51, Waters). 

Regarding claim 16, the limitations of claim 1 are taught above, Waters discloses the 
capturing is performed in real time to be analyzed upon capture (operating in real-time) 
(2:46-58, Waters). 



Application/Control Number: 10/506,368 Page 8 

Art Unit: 2622 

Regarding claim 17, the limitations of claims 1 and 1 1 are taught above, Waters discloses 
the transportation port is an airport (4:27-30, Waters). 

Regarding claim 19, the limitations of claim 1 are taught above, Waters discloses at least 
one first and at least one second interactions comprise a captured data, video and audio 
(video cameras 101-106, Fig 2, audio synthesizer 250, Fig 2, and data analyzer 240, Fig 2) 
depicting the interaction between the agent and the traveler (an event 242 generated by 
analyzing the relationships among the attributed objects, e.g. between a agent and a traveler) 
(3:4-51, Waters). 

Regarding claim 24, this claim recites same limitations as claims 10 and 13 combined. 
Thus it is analyzed and rejected as previously discussed with respect to claims 10 and 13 
above. 

Regarding claims 25, 26, 27, 28, 29, 30, 31 and 32, these claims recite same limitations 
as claims 2, 3, 4, 5, 7, 8, 9 and 10, respectively. Thus they are analyzed and rejected as 
previously discussed with respect to claims 2, 3, 4, 5, 7, 8, 9 and 10 above. 

Regarding claims 34, 35, 36 and 37, these claims recite same limitations as claims 11, 12, 
13, and 15, respectively. Thus they are analyzed and rejected as previously discussed with 
respect to claims 11, 12, 13, and 15 above. 

Regarding claim 38, the limitations of claims 23 and 33 are taught above, Waters 
discloses at least one and second interactions comprise a captured data, video and audio 
(video cameras 101-106, Fig 2, audio synthesizer 250, Fig 2, and data analyzer 240, Fig 2) 
depicting the interaction between the agent and the traveler (an event 242 generated by 
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analyzing the relationships among the attributed objects, e.g. between a agent and a traveler) 
(3:4-51, Waters). 

Regarding claim 40, the limitations of claims 23 and 33 are taught above, Waters 
discloses a local or remote operator for observing the operation of the apparatus (the 
apparatus can be under user control and the user can supply control signal to the system) 
(4:17-26, Waters). 

Regarding claim 42, this claim recites same limitations as claim 6. Thus it is analyzed 
and rejected as previously discussed with respect to claim 6 above. 

Regarding claim 46, the limitations of claims 1 and 10 arc taught above, Waters discloses 
the data capture device is a screen capture device (A security screen located at the portal 
screens each passenger as they pass through the portal for the presence of items such as 
firearms and explosives which are prohibited) (4:28-48, Waters). 

Regarding claim 47, this claim recites same limitations as claim 7. Thus it is analyzed 
and rejected as previously discussed with respect to claim 7 above. 

Regarding claim 54, this claim recites same limitations as claim 46. Thus it is analyzed 
and rejected as previously discussed with respect to claim 46 above. 
8. Claims 18, 20-22, 33, 41, and 50 are rejected under 35 U.S.C. § 103(a) as being unpatentable 
over Brooks (US 2003/0210139) in view of Houvener (US 6,757,408). 

Regarding claim 18, the limitations of claim 1 are taught above, Brooks does not disclose 
the interaction is associated with a baggage item. However, Houvener discloses the 
interaction is associated with a baggage item (the system may provide a safeguard that 
ensures that each passenger boarded a plane, that their luggage is on the plane, and that the 
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luggage is later claimed by the correct person, thus the interaction is associated with a 
baggage item) (6:13-25, Houvener). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
baggage check system as taught by Houvener into Brooks' system, as the combination yields 
a systematic process to increase the likelihood of detecting a known high-risk baggage, and 
minimizes the number of false positive identifications, thus provides a safeguard that ensures 
that luggage of each traveler is on the plane, and that the luggage is later claimed by the 
correct person (6:13-25, Houvener). 

Regarding claim 20, the limitations of claim 1 are taught above, Brooks does not disclose 
a quality assurance device for analyzing the at least one first or second interaction for 
analyzing the quality of service provided to the traveler by the agent, the quality assurance 
device using an at least one evaluation form of the apparatus. However, Houvener discloses a 
quality assurance device (an interactive multi-media training module of the identity 
verification system) for analyzing the at least one first or second interaction for analyzing the 
quality of service provided to the traveler by the agent, the quality assurance device using an 
at least one evaluation form of the apparatus (provides high quality data capture and 
screening by leveraging the interaction between screening personnel, i.e. an agent and people 
being screened, i.e. a traveler) (6:5-12 and 8:36-9:6, Houvener). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
interactive multi-media training module as taught by Houvener into Brooks' system, as the 
combination permitting a large organization to assure that their field personnel are providing 
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high quality customer service in a method that is considerably more efficient and effective 
than sending them to the field foe auditing and training purpose (8:36-9:6, Houvener). 

Regarding claim 21, the limitations of claims 1 and 20 are taught above, Houvener 
discloses the quality assurance device (an interactive multi-media training module of the 
identity verification system) alerts a supervisor where the quality of service provided by an 
agent fails to meet a predetermined standard (immediately react to issue noted) (6:5-12 and 
8:36-9:6, Houvener). 

Regarding claim 22, the limitations of claims 1 and 20 are taught above, Houvener 
discloses the quality assurance device (an interactive multi-media training module of the 
identity verification system) initiates a training session with an agent (the field personnel are 
prompted to participate in a training session at the next convenient time such as at the start of 
their next shift) (8:36-9:6, Houvener). 

Regarding claim 33, this claim recites same limitations as claim 20. Thus it is analyzed 
and rejected as previously discussed with respect to claim 20 above. 

Regarding claim 41, this claim recites same limitations as claim 21. Thus it is analyzed 
and rejected as previously discussed with respect to claim 21 above. 

Regarding claim 50, the limitations of claim 23 are taught above, Houvener discloses a 
step of checking whether a luggage belonging to the traveler has changed (the system may 
provide a safeguard that ensures that each passenger boarded a plane, that their luggage is on 
the plane, and that the luggage is later claimed by the correct person) (6: 13-25, Houvener). 
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9. Claim 53 is rejected under 35 U.S.C. § 103(a) as being unpatentable over Brooks (US 
2003/0210139) in view of Waters (US 6,396,535), and further in view of Houvener (US 
6,757,408). 

Regarding claim 53, the limitations of claims 23 and 24 are taught above, Brooks and 
Waters do not disclose the visual prompting of the screener, in synchronization with the 
collection system, yields a systematic, uniform, natural, efficient and optimal data collection 
process, However, Houvener discloses the visual prompting of the screener, in 
synchronization with the collection system, yields a systematic, uniform, natural, efficient 
and optimal data collection process (6: 13-25, Houvener). Thus it would have been obvious to 
one of ordinary skill in the art to have included the capture processor as taught by Houvener 
into Waters' system, as the audio, video, and data can be recorded synchronously. 

10. Claims 44-45 are rejected under 35 U.S.C. § 103(a) as being unpatentable over Brooks (US 
2003/0210139) in view of Houvener (US 6,757,408), and further in view of Brunetti (US 
6,507,278). 

Regarding claim 44, the limitations of claims 1 and 20 are taught above, Brooks and 
Houvener do not disclose at least one first agent-traveler interaction is of a different type 
from the at least one second agent-traveler interaction. However, Brunetti discloses at least 
one first agent-traveler interaction (an ingress activity or Q section 12, Fig 1) is of a different 
type from the at least one second agent-traveler interaction (an egress activity or X section 
14, Fig 1) (6:25-45, Brunetti). 

Thus, it would have been also obvious to one of ordinary skill in the art to have included 
the ingress/egress passenger screening system as taught by Brunetti into Brooks and 
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Houvener's system, as the ingress and egress portions of the security system can be 
implemented separately and operates as unobtrusively as possible without compromising 
security at the checkpoint, and while improving passenger flow and substantially eliminating 
bottlenecks (2:66-3:5 and 4:21-28, Brunetti). 

Regarding claim 45, the limitations of claims 1 and 20 are taught above, Brooks and 
Houvener does not disclose at least one first agent-traveler interaction or the at least one 
second agent-traveler interaction is selected from the group consisting of: ticket purchasing, 
baggage screening, check-in, passport control, passenger screening; and boarding. However, 
Brunetti discloses at least one first agcnt-travclcr interaction or the at least one second agent- 
traveler interaction is selected from the group consisting of: ticket purchasing, baggage 
screening, check-in, passport control, passenger screening; and boarding (a multi-stage 
screening of passengers entering the checkpoint) (3:21-38, Brunetti). 
11. Claims 51-52 are rejected under 35 U.S.C. § 103(a) as being unpatentable over Brooks (US 
2003/0210139) in view of Brunetti (US 6,507,278). 

Regarding claim 5 1, the limitations of claim 23 are taught above, Brooks does not 
disclose at least one first agent-traveler interaction is of a different type from the at least one 
second agent-traveler interaction. However, Brunetti discloses at least one first agent-traveler 
interaction (an ingress activity or Q section 12, Fig 1) is of a different type from the at least 
one second agent-traveler interaction (an egress activity or X section 14, Fig 1) (6:25-45, 
Brunetti). 

Thus, it would have been also obvious to one of ordinary skill in the art to have included 
the ingress/egress passenger screening system as taught by Brunetti into Brooks' system, as 
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the ingress and egress portions of the security system can be implemented separately and 
operates as unobtrusively as possible without compromising security at the checkpoint, and 
while improving passenger flow and substantially eliminating bottlenecks (2:66-3:5 and 
4:21-28, Brunetti). 

Regarding claim 52, the limitations of claim 23 are taught above, Brooks does not 
disclose at least one first agent-traveler interaction or the at least one second agent-traveler 
interaction is selected from the group consisting of: ticket purchasing, baggage screening, 
check-in, passport control, passenger screening; and boarding. However, Brunetti discloses at 
least one first agcnt-travclcr interaction or the at least one second agent-traveler interaction is 
selected from the group consisting of: ticket purchasing, baggage screening, check-in, 
passport control, passenger screening; and boarding (a multi-stage screening of passengers 
entering the checkpoint) (3:21-38, Brunetti). 
12. Claims 48 and 49 are rejected under 35 U.S.C. § 103(a) as being unpatentable over Brooks in 
view of Waters, and further in view of Eilbacher (US 6,724,887). 

Regarding claim 48, the limitations of claims 23 and 47 are taught above, Brooks and 
Waters do not disclose the analysis is spotting words said by the traveler. However, Eilbacher 
discloses the spotting words analysis technique (an analyzing unit 234 is a voice processing 
stress analyzer, in the case of word spotting, an analysis is performed on recorded audio such 
as a telephone call and the audio is automatically processed, searching for any key words on 
a predefined list which have been identified as cause for concern) (1 1 :26-61, Eilbacher). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
spotting words analysis technique as taught by Eilbacher into Brooks and Waters' system, as 
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the word spotting analysis can be done separately, or in addition to the stress analysis, which 
might tend to indicate an suspected customer experience, as the analysis is spotting words 
said by the traveler (11 :26-61, Eilbacher). 

Regarding claim 49, the limitations of claims 23 and 47 are taught above, Brooks and 
Waters do not disclose the analysis is stress detection of the traveler. However, Eilbacher 
discloses the stress detection and analysis technique (an analyzing unit 234 is a voice 
processing stress analyzer which can be used to perform the stress detection of the traveler) 
(11:26-61, Eilbacher). 

13. Claims 55-56 and 58-59 are rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Brooks in view of O'Hara (US 2003/0058084). 

Regarding claim 55, the limitations of claim 1 are taught above, Brooks does not disclose 
the rule assesses a change in an item associated with said traveler. However, O'Hara 
discloses the rule assesses a change in an item associated with said traveler (traveler's name 
or address) ([0025], O'Hara). Thus it would have been obvious to one of ordinary skill in the 
art to have included the method as taught by O'Hara into Brooks' system, as it enables the 
display of travel information in order to enable the ticket agent the ability to create a 
complete record of the person seeking passage on a carrier ([0025], O'Hara). 

Regarding claim 56, the limitations of claim 1 are taught above, Brooks does not disclose 
the rule assesses a disparity between an item carried by said traveler, and said traveler's 
destination. However, O'Hara discloses the rule assesses a disparity between an item carried 
by said traveler, and said traveler's destination (traveler's intended destination) ([0037], 
O'Hara). 



Application/Control Number: 10/506,368 Page 16 

Art Unit: 2622 

Regarding claims 58 and 59, these claims recite same limitations as claims 55 and 56, 
respectively. Thus they are analyzed and rejected as previously discussed with respect to 
claims 55 and 56 above. 

14. Claims 57 and 60 are rejected under 35 U.S.C. § 103(a) as being unpatentable over Brooks in 
view of Ritter (US 7,084,736). 

Regarding claim 57, the limitations of claim 1 are taught above, Brooks does not disclose 
the rule assesses a change in said traveler's appearance. However, Ritter discloses the rule 
assesses a change in said traveler's appearance (traveler's outer appearance) (claim 1, Ritter). 
Thus it would have been obvious to one of ordinary skill in the art to have included the 
method as taught by Ritter into Brooks' system, as it enables the system to allow or den the 
traveler access to the public transportation after said verifying and checking (claim 1, Ritter). 

Regarding claim 60, this claim recites same limitations as claim 57. Thus it is analyzed 
and rejected as previously discussed with respect to claim 57 above. 

Conclusion 

13. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: 

Kelly et al. (US 2003/01275 1 1) discloses a method for providing passenger 
accountability for airports and other mass transit facilities, 
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- Yagesh et al. (US 2003/0171939) provides an integrated knowledge management 
system specifically configured for the tracking, monitoring and management of 
hazardous materials, and 

- Chun (US 6,956,477) provides a multichannel image processor and a security system 
employing the same capable of remote controlling the movement of a camera from a 
user's computer, and setting up a function supported from the camera. 
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for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://portal.uspto.gov/external/portal/pair. Should you have 
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